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ABSTBACT 

The development and implementation of an evaluation 
plan for a district's program for the gifted is examined. The school 
system in question applied for state funding to develop appropriate 
instrumentation and implement such a plan. Its uniqueness was* in its 
attempt to secure funds for developing an evaluation foi^ a given 
prooram. Because the project called for test development, program 
evaluation, and curriculum evaluation and validation, specialists in 
these areas were included on the multi- disciplinary evaluation team 
along nith faculty members from the Evaluation Besearch center and 
Foundations of Education Department and graduate students. After 
ersmininq the program proposal, objectives, and curriculum documents, 
descriptions of the existing program for the gifted and the evolving 
program for students gifted in the fine and performing arts were 
developed. The 3-year project proposal called for development and 
implementation of an evaluation design, development of assessment 
instruments, and development of a plan for reporting student 
achievement. The team approach to evaluation resulted in bringing 
about the anticipated positive results. Various benefits accruing to, 
the university, school system, and the state department are 
identified. Components of the project are detailed in the appendices. 
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Evaluating a Local Gifted Program: 
a LEA/Unlveralty Cooperative Effort 

Ona of the lamenta heard f rom practitioners In the flietld of education Is 
the Inability of Ivory^tower academics to coonunlcate and work with them on 
solutions to Innediate real«life problv^sis* In tum» academicians question the 
ijq>act of their research and evaluation efforts on school problems (Ker linger » 
1977). In particular* the field of evaluation has often been criticized for 
not providing relevant » useful information to program deciislon. makers « (Cox, 
1977) « In spite of the introduction of the concept of formative evaluation 
and the expanded efforts to involve evaluators in program descriptions (such 
as tha Discrepancy Evaluation Model prescribes) » many evaluation efforts 
are still perceived as msndatory» perfunctory means of satisfying a federal 
grant requirement or a school board ^s accountability dema^s« 

Evaluation* fiurthermore» is often perceived as a judgemental process 
and a threat to programs rather than as an aid to program improvement « It 
ls» therefore* unusual to see an already existing* locally fxinded program 
actively seek funds for evaluation efforts. One of the unique characteristics 
of the cttrrent project is the commitment to evaluation by the program under 
scrutiny* The school system in question* realizing its own financial and 
professional limitations in carrying out program evaluation* applied for 
etate funding specifically to develop appropriate instrumentation and to 
develop and Implement a complete evaluation plan« Although the Title T7^ 
grant also included funds for the development of a fine arts program as an 
expansion of the existing program for the intellectually gifted* the primary 
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focus of the project waa the development and Isiplementatlon of an evalua** 
tlon plan for the district S program for the gifted. The uniqueness, of 
course, lies In an attempt to secure funds to develop an evaluation for a 
given program rather than attempts to fund programs and then attach an 
evaluation component. 

Background 

Evaluations of gifted and talented programs have been criticized for 
(a) over-reliance on attitudlnal data for assessing program worth, (b) use 
of Inappropriate (invalid) tests for assessing student achievement, and (c) 
leek of careful documentation axid evaltiatlon of the actual cxirrlculua 
implemented in a program. 

One impetus for the original proposal vaa the abovenaentioned lack of 
standardized instruments to assess the goals and objectives specified hy 
the program (primarily in the areas of analysis, synthesis, and evaluation 
skills) for the grade levels involved in the program (5^) . Although the 
BwsTeat of Higher Cognitive Processes (Jloss and Ross, 1976) has been used 
to assess achievement, the celling was too low for students in the upper 
grade levels. The scope of skills assessed by Wataon-Claser Critical 
Thinking Appraisal (Vatson & 61aser,19643 was considered too narrow, as were 
the Torrance Tests of Creative Thinking (Torrance, 1974) • A second impetus 
for seeking funds was a desire to collect valid and reliable evaluation data, 
but a staff with expertise in evaluation or the funds to hire external 
evaluators was lacking, 

Upon receipt of fu nd ing approval, the LEA sent out KFPs to a number 

M 

of agencies. Our university looked upon this particular project as an 
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opportunity to put together a oiultl^dlsclplinary team to respo;;^^ to the 
proposal. 

Pnlque Features of tha Eveluattou Teqi . 

In the Initial consideration of planning the evaluation^ i.: becane 
evident toat this project would require expertise from a number of different 
specialty areas « It was apparent that the scope of the proposed project 
clearly would require the consideration of program evaluation specialists, 
meuurement spadalists, and content area specialists « As many evaluators 
have pointed out» the content area specialists and research/evaluation 
specialists each contribute more to effective research and evaluation efforts 
when working cooperatively than when working individually* Because the 
project called for test development* program evaluation* and cturriculum 
evaluation as well as curriculum valldatlbn* it was determined that specialists 
in the areas of measurement* evaluation* curriculum and education of the 
gifted and talented should be Included on the staff « The final evaluation 
team Included one faculty member from the Evaluation Research Center* one 
faculty member from Foundations of Education (area of Gifted and Talented) * 
and three graduate students drawn from the Department of Foundations and the 
Department of Research and Evaluation. 
The Flannlng Grant 

Initial funding for the program was a small planning grant awarded for 
SumoMr* 1979. The most iomiediate concerns of this grant were the development 
of a plan for evaluation and the drafting of a specific Instrument to be 
used in assessing student achievement in the program for Intellecttially 
gifted students. Details of the test development effort will be presented 
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in another paper CAyleaworth, et al,, 1980), but a brief description of the 
efforts are given here. First, the staff examined the program proposal, the 
stated goals and objectives of the program, and existing curriculum 
documents Cprlmarlly mimeographed activity sheets) . Then the staff reviewed 
existing tests of the skills described, reviewed the taxonomy (Bloom, et al., 
1956) and other existing Instruments, and from these activities developed 
a list of the specific co^>etencies to be assessed. (See Appendix A). An 
item generation phase followed. During this period, an attempt was made to 
S^Mr^te both verbal and non**verbal items, and supply and selection items 
(as the objectives suggested). By early fall, a pool of items vas available 
for pretesting. 

A second task undertaken by the project staff vas a description of the 
existing program for the Intellectually gifted and a description of the -evolving 
program for stxidents gifted ±n the fine and performing arts. Using the con- 
ventions of the Discrepancy Evaluation Model, a program description vas 
developed and presented to the project staff (See Appendix B). The development 
of this program description and discussion of the components with administrative 
officials and staff pointed to several program concerns which had not been 
identified earlier. The most significant observation vas the lack of clearly 
identified project management responsibility. Although the administrative 
assistant ^o the superintendent had ''legal" responsibility at the local 
level and viae designated as the project director, the person most responsible 
for program development and administration vas a teacher from the academic 
program. Specific proposals for modification of this administrative 
arrangement were made to the central administrative staff. 



Evaluatlog a Gifted Prograffl 
5 

FliuuLl]r> A proposal {or a tbreet^7«ar project vas drava aad submitted 
for approval. 

The Proposal for Evaluation 

Tha original project proposal called for the development and Ixsplemen- 
tatlon of an evaluation design, the development of assessment Instruments » 
aad the development of a plan for reporting student achievement. 

As a reault of the vork of project staff over the summer months, it 
was determined that the tasks of evaluation and program documentation would 
be of limited use without the additional process of curriculum docunien tatlon. 
Thus, additional components relating to the development of a curriculum 
framework were added to the proposed tasks of the team. A suonary of 
proposed taaks to be carried on by the evaluation team are presented In 
Appendix C. 

* 

Documentation of Acsdrmlr Curriculum Development 

Work on curriculum development by the evaluation staff began with a 
review of the curriculum materials provided us by the local program staff. 
In this review the following problems were Identified: 

1. that the units appeared to lack any clear rationale for selecting 
activities; 

2. that the actlvltlea were exceedingly brief and generally fairly simple 
considering the students In the program; 

3. that there seemed to be no sequence to the actlvltles~any one could 
have followed any other; 

4. that there were no clear content or skill objectives stated or lisplled, 

5. that the curriculum materials were not In a format conducive to 
comunlcatlon to us or others. 
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Becauaa of these problems the first meetlzig regarding the academic 
curriculum had these purposes: 
1« to agree on a format that would communicate their currlcular activities 
and objectives; 

2. to identify specif :*c program goals; 

3. to Identify their general organization for instruction within which the 
developed curriculum would fit; 

4. to develop a rationale for selection of content; 

5. to develop a rationale for selection of skills; 

6« to point out the Importance of sequence and a variety of ways it could 
be accomplished. 

Toward these ends the evaluation staff; 

1. constructed and reviewed the results of a questionnaire pertaining to 

0 

familiarity .and attitude toward certain basic curriciilum concepts. Results 
suggested that the problems identified in the curriculum review were due 
to a lack of skills in Implementing or conmtunicating concepts rather 
t£bszi a lack of familiarity with them. 

2. present edi the program staff with some options available in planning 

for scope and sequence across the four grades of the program; from these 
options the program ataff elected to develop 24 content units and use 
six per year so that all four grades would be using the same unit with 
no repetition of units for students across four years in the program; 

3. presented an example of a/currlculum documentation format based on 
one of their previous units which would identify the major elements 
of their units and activities; revisions were made on the format 
presented based on their suggestions (see Appendix D) ; 

o . 8 
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4« dlscuaaad program rationale, goala, azid general organization for instruc- 
tion vlth the program ataff; 

5« dlaeuaaed criteria for assessing objectives, resources, and activities 
vlth the program staff* 

Curricular aateriala sent to us following the initial meeting suggested 
that the only thing communicated was bow to document activities « The following were 
considered to be the major problems facing us: 
1« activities were connected to goals In only the loosest sense; objectives 

listed for activities were rarely curricular objectives; 
2« activities selected were not sequenced In any manner that would, allow 
for skill development; 

3. activltiea were not of a type that would allow for multiple depth of 
Inquiry as was necessitated by choice to use the same unit content for 
all students in the program; ^ 

4. activities were brief and well below the abilities of the majority of 
stxidents in such a program. 

The evaluation staff constructed a sample unit based on the guidelines 
developed at the initial meeting to point out a way that these problems could 
be ovetxome. Since we did not feel it was appropriate for us to write their 
curriculum, we chose a topic quite different from those they had selected « 
In a second meeting with the program ataff, 
1« the curriculum problems were identified 

2« the sample unit was presented showing how these problems could be overcome 
3« we worlced with them to develop a unit on a topic they Intended to use« 
In this we noted a great dependence on the resources of the program as 
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a source of simple activities* Accordingly ve developed a unit to show 
hov the resources of their program and coaoBunlty could be used as 
resources for activities more appropriate to the students In the program. 
4« After presenting this sample unit ve worked with them on their plans for 
future units* 
Documentation of the Pine Arts Program 

Efforts to work with the visual arts and dramatics programs on documenting 
their curriculum began vlth a review of such programs In the existing 
literature. Finding little to guide our process, ve began to create a 
structure which seemed both efficient and effective in conounlcatlng and 
organizing the activities of these classes. 

During the Initial visit with the program staff, the following 
activities took i>lace. 

1. A discussion of the need for curriculum docxmentation for evaluatidn 
purposes was held. 

2. The evaluation staff presented a structure for organizing goals, 
objectives, and activities Into a curricular framework and a format for 
collecting Inf ormation was agreed upon (See Appendix E) . 

3« The combined staffs discussed the appropriateness of the stated program 
goals. 

4. Agreement was reached that the staff would forward activity cards or 
lesson plans as completed. 

As only two activity cards ^^re forwarded during the next two months, it 
was determined that alternative strategies for collecting the Information 
were In order. 
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A aaCQod on^alte visit produced the activity cards for the drama program 
and alloved for a beginning of the curriculum design process. The art 
program staff agreed to be more prompt In the future but another period of 
two months elapsed with no further documentation. As a result* It was 
proposed that slides and tapes of actual classroom activities be produced 
and forwarded to the evaluation team. That process has been the most effective 
Mans of eltsiitlng the documentation sought by the evaluation staff. 
Student Progress Reporting Forma 

As a result of the Interactions of the evaluation staff with the 
a c ademi c program, the art program, and the drama program. It was determined 
that a form should be developed which allowed for both the teacher 
evaluation arul the student self -evaluation. A sample of these forms 
la provided In Appendix F. 
Other Instruments 

One other Instrument Is currently being piloted. "Something About 

measure of students' perception of self in regard to independence, 
responsibility, goal setting, personal competence, and sociability. Students 
will also be pre- and post-tested on the Piers-Harris (Piers and Harris, 1969) 
and appropriate questionnaires for measuring attitudes toward the program will 
be administered this spring. 
Observations of the Team Approach to Evaluation 

The team approach to evaluation (the team Includes both evaluation and 
content specialists) has resulted In bringing about some of the anticipated 
positive results of lending a wide range of expert abilities to the tasks. 
However, it has also presented at least one unexpected issue. Early in the 
process of program description and review of the program's existing 
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currieuluot; it becama apparent to those persons working on the development 
of the ourricular framevork that the existing curriculum fell short of meeting 
gen er a l ly accepted criteria for curricxtlum design* Therefore, persons on 
the team vfaoaa e3^ertlaa fell in the area of curriculum or education of 
the gifted and talented vere faced with a dileama centering on the conflict 
betveen the evaluator role and the curriculum consul t:ant role. Rather than 
interpreting this circumstance as a difficulty, ve approached it as a 
plus for the team. Those persons vith curriculum expertise intervened by 
providing consxiltation on Improving the curriculum while allowing the 
others to maintain more of an objective posttxre toward the data being 
collected. 

Benefits to the Agencies Involved 

A joint effort stich as the one described above should encourage symbiotic 
relationships rather than a parasitic feeding of one agcmcy upon the other. 
To date we have been able to Idenfity a number of benefits and/or potential 
benefits accruing to at least three agencies: (1) the university, (2) the 
school system, and (3) the state department as the funding source. We hope 
that other school divisions will stand to benefit from use of the Instruments 
developed as part of the contract. 
Benefits to the LEA 

The major benefits to the school system which have accrued to date lixclude 
the foUowtag: 

1. Dcvelopoent of a program description and documentation of program 

functions and components. Through this process we were able to identify 
and confirm several areas where administrative functions and responsi-* 
bility were unspecified and unclear to parties Involved in the program. 



12 



Evaluating a Gifted Program 
U 



FurtbaxBora, ve vara able to aaka aavaral racommandatlooa relative to 
adalnlatratlva structure early enough In the year for consideration In 
budget proposals and hiring for the coming year. 

2. Claarer specification of program goals and objectdtves. Because the 
teat development proceas requlrea considerable delineation to the 
akilla to be aasassed, the program staff and evaluation staff vere 
required to carefully review statenents of ciirrlcular goals as well 
as specific objectives. 

3. Documentation of exiatlng ciurrlculum. Through the development of a 
mutually agreed upon format for recording Information relative to the 
day-to-day activities of the program (both academic and fine arts) 

me have been able to collect and organize the existing activities. 
We hope that these efforts vlU provide for greater '^transportability^* 
of the program. So often experimental programs only exist, In action and 
It la difficult to disseminate more than the administrative prccedtires. 
In this case, there will also be a complete description of the curriculum 
for the purposes of both dissemination and future program use. 

4. Consxxltatlon on currlculxm development and Implementation. Because our 
staff Included persons whose fields of expertise Included currlcxilum 
theory and practice as veil as education of the gifted , ve are able to 
revlev the existing cixrrlcxilum as ve go through the documentation 
process and suggest specific strategies for modifying the curriculum 
according to current practice in the fields of cxnnrlculxmi and education 
of the gifted. 

5^ A system for reporting student progress. Specific reporting systems for 
the academic and fine arts component of the program were developed 
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through a cooparativa effort of the evaluation and project staff. (See 
Appendix F). 

An evlauation plan. The development of a complete evaluation plan 
should serve both as a guide for the implementation of the current 
evaluation project, but also will serve as a guide for continued 
evaluation efforts after the state funding has ceased. 
A needs assessment for determining administrator attitudes and values 
concerning gifted and talented students and the current program. 
Basults of this need assessment suggested that principals from feeder 
schools indicate that administrators do not have a clear perception of 
the philosophy and goals of the program or the needs of gifted students. 
The project staff also completed this questionnaire (See Appendix G). 
A cdmparison of the two teachers in the academic program show very 
close 'agreement* but a comparison of these teachers' responses to 
those of the administrators showed very little agreement on what is 
happening in the program of what would be happening. This clearly 
suggested a need for further inservice of personnel outside the project 
staff. 

Other projected benefits to the program will include: 

A set of validiited and normed assessment tools to use in assessing 

the program. 

Just as the current evaluation design offers a structure for future 
evaluation* the current curriculum development consultation offers the 
LEA a framework for future curriculum development. 

An information base for progrsm planning and development over the next 
few years. 
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Banaflta to tha SKA 

Aa tlMi funding aourca, tha SEA should expect benefits from a project 
which era ganarallsabla beyond the particular system vfalch receives the funds* 
there ahmild be aeveral specific products aaaoclated vlth thla cooperative 
effort vhlch vUl be uaeful. to other programs In the state (end perhaps 
programs In other states). Anticipated benefits to the state vlU Include; 

1. A guide for evaluating programs for the gifted and talented. Using 
tihls particular program as a model* a step^by^step guide to evaluation 
of such programs vlll be produced. This guide may be used by the SEA 
la guiding other programs through Internal evaluation efforts. 

2. A model project vlth complete doctanentatlon of program activities and 
curriculum The documented curriculum guide should be useful in gxildlng 
Others who are in the process of developing programs l;i either the 
academic or fine arts areas. 

3. A test of thinking process skills vhlch assesses those skills commonly 
stated among the goals and objectives for programs for the academically 
glftedt and therefore* of use to many programs throughout the state. 

4. Validation of other exlstlx:ig Instruments vfalch vlU provide useful 
data In the evaluation of other state programs. 

Benefits to the Pnlversltv 

1. As an Institution vhlch has masters and doctoral level programs in 
both evaluation and education of the gifted* thla project provided 
tra ining opportunities for students in vorking on curriculum development* 
test developments and program evaluation tasks. 

2. It provided the faculty involved vlth the opportunity to work cooper a«> 
tlvely across departments and to make contributions to their fields 
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through the products of the project enumerated above. 
It provided faculty with an opportunity to Investigate the relationships 
betveen theory and practice, and to Improve coasmmlcatlon between 
themselves and practicing professionals. 
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iRBEU^ kt TEST OBJECTIVES FOR CO taimvg ASSESSMENT INSTROMENT 
Analysis 

s« tto dsf ins. s problsm 

b* to distinguish rslsvsat from irrslevsnt information 

to rscognias statsd and unststsd assumptions 
d. to salaet ralsvant faTpothasss 

a« to distinguish conclusions from supporting statsmants 
t. to racognisa aabiguitx ttd contradiction 
g. to racognisa taaie tarms and intarralations 
h* to idantify aotiva» point of vlaw, and bias 
i. to racogniaa saquantial ralationships 

Synthasis 

1. to ganarata Information to solve a problem 

m. to formulate and modify hypotheses 

tt. to make valid impllcatiooB based on Information 

o. to devise a eat of abstract relationships 

p* to organise a set of Ideas 

q* to formulate logical experiments 

r. to adapt materials to different situations 
(analogy as a special case) 

Evaluation 

u. to identify appropriate criteria for evaluation 

V. to make judgments based on comparisons with criteria 

V. to detect fallacious reasoning 

X. to Judge whether information is reliable and valid ^ 
y« to separate rational from emotional reasoning. 
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PROJECT NARRATIVE 
MIDDLE SCHOOL ENRICHMENT CENTER ' 



. Th« Mlddltt School Enrlchmwc Cancer is a project receiving Title IV-C and local 
foads \ixieh ••r-zes gifted and talented middle school students from the three middle 
schools In Ssglaaw Township, Michigan. The Enrichment Center is housed In one of the 
■Iddle schools and operates as a pull-out program with class groups of 12-15 selected 
seudeats attvndiag the Center for % day per veek. The Project has a budget of approx- 
iMtely $130,000. is staffed by a project director, 3 half-time teachers, and a derk- 
s«etetary, ami is supervised an assistant superintendent. 

One covpoiMnt of this project, a program for academically gifted students is in 
its third year of operation and currently serves a population of 150 mlddU school 
stadeats tdsatified as •eadeaically gifted using group I.Q. and achievement scores. 
Though the progrsa uses subject matter content as raw material, the focus is not on 
scqulsieioa of kaovledge, but instead on increasing students' abilities to utilize 
thm hl^isr level thinking processes - analysis,, synthesis, evaluation, and creative 
proUen-solviag. Other goals pertain to the affective domain in terms of values, 
usderseaading oneself sad others, and self-directed learning. 

This year, the Earlchaent Center has been expanded to serve students identified 
as talented in the fine or performing arts. During this first year of operation, 
this progrsa eoapdnent is limited to visual arts and draaa. Students are selected 
for participation in those programs through the use of locally developed identifica- 
tion iasertsMnts. • Currently i the program is serving 120 students - 60 in drama and 
60 in visual arts. The program goals are reUted to aesthetic appreciation and devel- 
opasne of skills associated with various media. 

Due to the lack of appropriate evaluation strategies and instruments for programs 
of this type, a third major thrust of the project is in the area of evaluation which 
is being handled through a sub-contract with the Evaluation Research Center of the 
University of Virginia. In response to perceived needs, the evaluation has been 
expanded to include certain curriculum development activities. The major goals in 
this are are curriculua development in the academic and fine arts areas leading to 
progrsa validation, and development of instnaaentatlon and av evaluatlea system for 
both areas leading to a Model Evaluation Guide. These evaluation activities are 
being aonitored by a third party evaluator conducting a meta-evaluatlon. 
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Titli IK Grant $91,986 

locil Support 29|874 

UVA Donitfld TlM 2»661 

Stiff 

1 Projiet Mnetor 01001 
3 tatcheri 9502 

1 Clerk/Sacrittry 9100X 

Raceptori 
270 Studanti 

Pacllltlefl ' 

EnrlchMnt Center tooi 
Offlca Space 

2 Storage loom 

Art Rooi 

Audltorlin 

Instructional & Nlicellaneoua 
SuppUea 

Llaaon 

Soglnav Townahlp Comuhlty 
Schools 

Title IV-C 

Unlvertlty of Virginia Evilm- 
tiOD Research Center 

CoMMinity Art and Draw Assoc- 
iations 

P^'*nt8* Croup . 
B^^yaitutlon Consultant 
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OUTPUT 



The Middle School Enrichient Center offers 
progriM for those 5th through 8th grade atu- 
dents uho heve hem identified as aeadtMicaUy 
gifted and/or talented in fine and perforiing ' 
arts. Htudsnts fnt the three liddla schools in 
the school district attend the Enrichient Center 
for one-half day per week where they engage in 
activitiea designed to leet their educational 
needs relative to their 'identified areaa of gif- 
tedneis. 

In addition, a najor effort is being lade 
to design, develop and validate strategiea for 
assessing prograi success through a sub-contract 
vith the Evaluation Research Center of the Uni- 
versity of Virginia by vhlch a gifted/ieasure- 
■ent/evaluation teai vorks closely vith local 
staff in the areaa of currlculua developnent/ 
docuientatlon, inatrunent developient and eval- 
uation design. A third-party evaluator con- 
ducts a review of evaluation activities. 



Strstegies for aiseaslng student 
growth in the acadeiic coiponent. 

Strategies for sisesslng student 
growth in the fine arts coiponent. 

Stsff trsined in curricului devel- 
opMnt. 



Students who have increased 

- akiUs In higher level thinking 
processes. 

- self-direction In learning. 

- awareness of local and world- 
wide social issues. 

- understanding of theuelves and 
others. 

- awareness of the relationship 
between values and actions. 



Students who have Increased 

- akills associated with various 
■edia in the visual arts. 

- sbility in uking aeathetlc 
Judgients. 

- .vocal and pliysical expressive 
abilities. 

- awareness of the use and effect 
of costuae and lake-up. 

Heta-evaluation of evaluation 
activities 
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um, III 



iNFurs 



PKOCKSS 



ouTi'in' 



Staff 

frajict Dinetor 
Vliuil Arts teichdr 

Receptors 
60 Students 

ractiitles 

Enrlchient Center Root 
Art Rom 

Instructional & Hlscellaneous 
Supplies & EqulpMnt 



ERC Evaluation Teai 
CoMunlty Art Associstlons 



2.1 Ulth the assistance of the M Rvaluatlon 
Teat acting as curriculn consttltsnts» sod the 
Project Director, a curricului for each grade 
level is developed and docuiented. Tlie prograi 
is devlded Into three lajor sessions progressing 
froM sliple to coaplex in tens of ledia. Each 
aession includes sons exposure to content such as 
history or other artiats' works but eaphaalxes 
active, participatory atudio experience, 

Students selected frw liddle school studente 
vho express Interest in the prograi attend the 
Enrichnent Center for onei-hslf day per week In 
class groups of 12 to 15 students. 

Student progresK Is reported to parents, 
fitudunts and "hone bASi*" UMchers. 



Students who have increased 

- skills in recognitlng design 
elenents. 

- abilities to lukc aesthetic 
JudgMnts. 

- skills sssodated with various 
■edia. 



Portfolios of student works, 



Docuiscnted curricuium baHis! on 
progriin gonls fluitnhlc fur ro|>il- 
catioiu 



Student progress reports. 
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INPUT 



PROCESS 



OUTPUT 



Staff 

Bvaluition CoMultint 

Materlila 

Doc«iMiitation of projact 
avaluatlon actlvltlaa 



6.0 A third- party avaluator conducta a ravlaM Hata-evaluatlon of project evalu- 
aod avaloatlon of project evaluation activitlea. tioo activltlea. 



lEVBI.li 
FHOCESS 



OIlTI'ilT 



5«0 Thi Project Director conducti lluon vork Projict lupport free the verioui 

vlth the three liddle echool princlpile nA the liieoae. 
Dletrlct CttrrlculiM CouocU, the Ferente' Group, 
end through the uiletent luperlntendeiit, the 

Stete Title IV-C office reletlve to grant contln- UVA-ERC aeslstance In currlcului 

uetlon. developient end evaluation actlvltlei 



The fine arte teachera lalntaln llaaona 
vlth coaunltjf aaaoclatlon in their reapectlve 
areaa. 



In addition, regular coawinlcatlon la laln- 
talned vlth UVA-ERC relative to currlcului devel- 
opient and evaluation actlvltlea. 




LEVEL n 



im 



PIOCESS 



OUTPUT 



8Uf( 

Aiilitint SttpirlBttndMt 
Project Director 
Project Teachere 

PeclUtlee 
Office Space 
Miecellineoue Supplies i 



Equipient 



Liaeon 



iO The evaiuation ectivitiei ere conducted 
through a eub-coatract with the Evelnetlon 
leiearch Center of the Oniveraity of Virglnie 
who ie providing en evaluation tMi to vork 
closely vith the project ataf f . These activitiee 
eoneist of the developient and validation of the 
acadenic curricului, the developient of e fine 
arte curriculun, the evaluation of the acadeiic 
and fine erte prograu, and the drafting of a 
Hodel Evaluation Guide. 



Validated ecadenic currlculm. 



Fine arte curricului. 



Acadeiic prograa evaluation. 



Fine erte prograi evaluation. 



Hodel Evaluation Guide in draft 
fori. 



Etc Evaluation Teal 
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LEVEL It 



iNPvr 



PIOCESS 



OUTPUT 



3.0 Vndtr tin direct iuf>irviiioo of thi iiiia- 
taot lupirintndmt, tbi Frojiet Olmtor pic- . 
(oiM idilnlitritlve dutiti vblcb loelitdt mIic- 
tlon of projict itiff lod irriniing of ptofiii- 
loMtdtfelopaent aetivltiii for cha. The 
Project Director It reeponiibh for the diiiei- 
inatlon of project infonatiOB to dietrict itaff , 
parenti, and commlty Miberi. In addition, 
the Project Director aupervlaea ctirricului 
developMot, docuMntatioDi and iipleientation 
including Hlntenance of the Enrichient Center 
Hiacellaneoua Suppliea & E^uipieot and acquiaitioo of resources necessary for ir 

pleientatlon. 



iciff 

Projict Mrietor 
Ctr/k/licretary 
Aaaif tent Superintendent 

racllltiei 
Office Space 
Storage Room 



Selected and trained staff, 



Infoned district staff, parenti, 
and GOMwnity leibers. 



Corrlcdlui developient supervision/ 



Efficiently and sioothly iiipleiiented 
prograi. 
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PIOCESS 



OUTPUT 



Stiff 

FnjMt Birietor 
Vlioal Arti Taiclur 
ftrautle Arti Tiiebir 

lecipton 
IZO Studeaci 

Ficlllcici 

EnrlcbMnt Center loot 

Art ioM 

AttdltorluM 

Instructional t HlieeUeneoui 
Supplies i Equlpient 

Usson 

PIC Evaluation Tew 

CoNHinlty Art A Drain Aesoc- 
lations 



2iO During this first yesr of operation, the 
fine arts prograi eonsists of visual arts aw) 
driiatic arte coiponeata which serve separate 
groupa of 60 students in each coiponent* 



Students uho have increased 

- skills associated with various 
iedla in the visual arte. 

- ability in laklng aesthetic 
Judgnents. 



Students who have Increased 

• vocal and physicnl expressive-' 
nesSt 

- awareness of the use and effect 
of costuw and noke-up. 
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OUTPUT 



Stiff 

: llnjiet Hrietor 
iTuehir 

lidSta4mti 

lielUdM 

IsrichMnt Centir loM 

iMfcruetiOMl ud HlsciUiMoai 
8y|H>Ui and E^uipMnt 

liiion 

UVA-aC EvaliMtlMi T«M 



U VIA till MilitiQci of tiM UVi Eviluitlo^ 
Tim ictlfli II turricttliii coMulciati ipd thi 
Nict Umtor, i cttirUttln for 1^^^^ 
hvil li diviioptd lid jbcuMiitid. Hm currier 
ill iri oriMiiid li ^11^ 
divldid liitb I to f topliil wfCiDlDi iich 
oalt niNlvidid iito Vor 5 pirti« ileli of 
wbicli teglQi Hitb I iiniril Introduetloi ind 
prociidi to I virlity of Ictlvltlei froi whicb 
itiidenti choMi one or aori to puriue in 
breadth or diptb. ' 

Student! are aelected f roi all ilddle 
ichool itiidenta ii the district and attend the 
Enrlchient Center for oni-half day per week in 
class groupa of 12 to IS students. 

Student progress li reported to parents, 
students and "hoie-base" teachers. 



. ■ ■ 

bocuMited curricula based en pro-^l 
grii goali suitibli for replicitlil^ 

' " ^ ■■ ■■ ,■■■'■^1 
Studnt progress reports. 1 

■ % 

Students vbo have increased | 

- skills in higher level thinkitii| 

' . processes. • , . , ■ ^l '-;,., - 'I 

- self-direction in learning. | 



awareness of local and world- 
wide social issues. 



understanding df tlieiselves and^l 



Others. 



awareness of the relationship 
between values and actions. | 




^samiya c: samDsssnAL dbsouption of evaloaiioi Acnrnizs 




SQPPUMBIIUyL 



OBSCBZPTIOIf OP BVALUmCN ACTX7XTIES 



Xht pcopoacl for tht« grant it unique in tea focut on th« evaluation of 
aav«alatiat profraa rathar than tha ganaration of an antlraly natr instrueti-onal 
progtaa. That la, dw. produeta and proeeaaes of thaaa aetivitlaa viU not ba 
41r«(plsiid at briagliit about child nd/or taacbtr ehangt, but ratter tbay focus 
on tha cowtruetioa and validation of instraants, evaluation dasigna, curricula 
iad raportiag proeaduras. Tharoforap tht traditional fotmat for raportlng tha 
aetivitlaa of tbo planning phaaa and projecting tht implemeatation activities is 
not sttffieiant for dascribiag ti&a activities to be carried out in the evaluation 
cepponant of tim Saginav grant. Ka thus, offer this supplemental outline of the 
ujor products and tha process for developing those products* During the pltiming 
phaaa (not ccnqplate until Aueust 31, 1979) a coe^lete progrsa analyais vill be 
cottpleted in order to elaborate upon the general plan for the three year iotplemen- 
tation phaao* At this point, the following products end ectivities have been 
identified: 

Development of an Evaluation Design for both existing and new components 

of the Saginaw program for gifted and talented students 
Preparation of a Validated and Homed Assessment Instrument for Measuring 

Critical Thinking in grades 5-8 
Preparation of Validated and NOimed Assessment Tools for assessment in 

the Pine and Ferfoalng Arts in grades 5-8 
Devalopoent of a Model Pro g r a m Development and Curriculum Guide for the 

Intellectually Cifted in grades 5-8 
Development of a Model Program Development and Curriculum Guide for the 

Talented In the Fine and Performing Arts In grades 5-8 
Oevalopment of Dtiit Tests to Accompany Curricular Dhits 

five major products have been Identified during the planning stage as the 
focus tot tha first year's activities. 



(1) An Svaluatloa of tlw Existing Program for the IntellectuAlly 
Gifted 

(2) An Evaluation of tha Proposed Prpgram for the Talented in 
Pl?ia and Perfomlng Arte 

(3) A Program Document and Curriculum Guide for the Program for the 
Zntellactually Gifted 

(4) A Program Docunent and Curriculum Guide for the Program for the 
Talented in the Fine and Performing Arts 

(5) A Draft of a Model Evaluation Guide 

Each of these major products is comprised of numerous activities: art -products 
and descriptions of the specific activities, rationale and product outcomes for 
each are included in the sections which follow. 

Evaluation of the Existing; Program for 
the Intellectually Gifted 

The general rationale for the actlvlfies in this component has been given 

in original proposal. The specific activities to be carried out during the first 

year of the project are outlined below. 

I* Program Analysis (to be complete by August, 1979) 

A* Analysis of Existing Documents 

Analysis of Data Collected 1977*1979 

C. Site Visits 

D* Product • Written Description of Current Program 
Including History 

II* Evaluation Design (to be complete by August, 1979) 

A* Pre-post comparison on instruments in III-A, III-B 

B« Post test control gtovcp comparison on instruoients in lU-A 
and in-B 

C* Attitude surveys 

D« pTTodnet « Evaluation Plan for 1979*82 
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^^r. .::,:;..^,;^;|!^^ . . ■ 

-v : - tUaislas. Skills ■ : 

UMl i l^ i iin t^ itiliittoMhlp to othtr tift«d» 

'':''''tiv«ni« ..................... 

0. I»«eiiiS f«re«ptioas 

B. l4|iiai«mtOT F*re«p 

ZV. tef fn iii n e and V«lld«tlod of Soloetod iMCroBsnt* from IZX 

A. AMMSMnt of Critical Thinking; Skills 

I* Pilot TSst of Itams (pro test) for Sagi^ 

a. CalcttiUta itSB analysis data (difficulty, 
diseriaination, ambiguity , ate.) 

, -I'JIjg'ff • Jj^SsvmljssmMUtSaost- - - - - - 

c. Assess aquivalaat focns valiabillty 

d, Bafiaa iBstrument and admlnlstar as a post tast 

/> ■ 

CollMct XQ (gr0 • 8) and ItM« iMt (gra 5 & 6) 
dats for uaa in conatruct validation 

2. Aaaoaa Content Validity of Znatnaant - Export opinion 

3. Control Group Validation on Rafinad Inatrimnt 

^ Zdantify aatdiing populatipna of intallactually 
giftad atudanta (ona in a giftad program, ona 
not in a giftad program) ' 

b« Adniniatar rafinad inatrtananta aa a poat taat 

c« Adminiatar Eoaa Taat (gra 5 & 6) 

di Cathar data on achievemant 

a a Aaaaaa aquivalant forma roliability, intamal 
conaiataney 

f « Aaiaaa convargant/diacrlminant validity 

4a Drav up plan for tha collaetion of noa group data in 
198(K81 

5. Prapara a final ''raady-to-go" inatruaant and adminiatration 
taaaaail « product 



I. Smo proMdiiMt M «bov« (excapt tubseitucing appropriate 
JMmovM for conseruet valldatloxi and tlialtiAtlng 
•4ulyftlmt fom 

G. Attitnido Survay FocM 

U AiMsa latamal contlttoncy nod contaat validity as 
a p pii o pg latt 

V. txtamal Itspart Validation of is procaduras, cnrriculuoi and 
progiMa 

VX. Collaet avaluatim data, aaalyso data 
▼XZ« Prtpara a final raport 

Svalgation of the Fine Arts Covponant 
tha ratlotiala for this aspact of tho evaluation is much the sane as one 
notad in the earliar proposal with ona significant additional consideration, 
.i^a^.^-.4»Qls^for-aaaesslng^^ 

|hoM tor atasnriat erltlMl thlaktag skills and will r^nirc tty th«lr very 
aatm tiit eensldtntlon of uaiqae sad non creative asscssmime." The plan for 
tiie~«v«laaelMi of this eonponene will be very similar to the plan for evaluating 
the aslatlBt progrsB for the intellectually gifted students with one notable 
dlffereaee - tiaiag. That is, the existing program has its goals and objectives 
identified and has a program in place. The new program is not cl-«arly defined 
P*f *■ curriculum developed. Therefore, program analysis will be a major 
focus of the academic year and instruments will only be in tryout f otm by June, 
IWO. ♦ 

J Z. Progm Analysis (to be eooplete by June, 1980) 

*s . 

J A. Analysis of Beveloping Program (including an analysis 

of such factors as characteristics of successful 
instructors, etc.) 

»' 

B. Site Visits 



C* Jhco^e m^^ Doewtnt Describing the Bacisttag Program 

^y ^. belov) 

1. Cooparisra <m Sel£«pereiption 

IMHra (iW nz-B under Evaluation of Bxlstli« 

0. fi^odnet f Svmloation Plan for 1979-1982 
ZZZ. l)eiPelopBittt of laadnaientatlon 

A. DivelopMnt of several alternative strategies for Masuring 
adbieveaent.in the fine and performing arts (by Janoaryi 1900) 

B# Parent Perception Instrwent 

C. Teacher Perception Znstnnant 

!>• Administrator Perception Instrument 

1. Coamunity Instructor Instrument 

f • Self •Perception Instrument (as in III-B in Evaluation of 
Ixisting Program) ^ 

Vr. Rafinenent and Validation of Instrtmients ^ III above 

A* Achievement in the Pine and Performing Arts 

1. Assessment of inter-rater reliability, internal consistency 
of proposed strategies (Because ve are likely to rely on 
video tape, audio tape, product and performance assessment 
as ifell as paper and pencil knovledge this will be crucial.) 

B. Saott Procedures vill be used for HI: C - 6 as in Evaluation of 
Existing Program 

7* Collect Evaluative Data, Analyze and 

VI. Prepare Pinal Bepox:t 

Preparation of Program Descriptions and 
Curriculum Guides for Both Coiqionents of the Project 

One Intended outcome of the evaluation efforts is the validation of a 
i^rogrem iri&ich can be usefully disseminated. This relies heavily on the documen* 
cation of the program - a task, often neglected by the staff of programs for the 
gifted due to their lack of training in progrsm analysis, systems description writing 



iji CollMt HU«i^ lljMWta ia Bxlttias 0*ta 
?• tvtparil Cotrlenlui <Soi4« in CoajuaetioB with Project Stmff 

Draft of Bvmluation Htmuil 
MiBjr prngnu for tbm giftod find thovsolv^s unablo to produeo vulid tad 
CTtdiblo avidtiieo of tbolr offoctlvtnMa to funding AgMcios* This shortcoslng 
Mriooaly joop«rdlMO tb* osdUtonco of thoso programs* tblM projoot offors tiM 
o p p ortu aity to provido guldallnos to tboso sooklng to ovaluato tholr prognou 
la AH Affleioat yot Juttlflablo fMhlra through ma ongoing oxn^lo* Tho 
fvmluatlon Mnnal vill docunnt tho ovmluatlon process in « stsp-by-stsp fsshion 
|(lvii«i| ratimnlo and guldoUms for Its uso plus the InstraBsntation dsscrlbsd la 
tiM pracoding; P«gt9« Xt will also provide tha current Ssglnssr Township project 
^th titm Mens to carry on an Ineaepenslve, continuous nonltorlng of Its own progrstt 
imd to dewmstrata to others hov evaluation can be carried on Iqr local personnel 
VIA a ttislrai of consultative tim* During the first year an outline* of the 
process of coavUtlng the first year's activities will be drem up vith sample 
voric pages and instrusisnt davelopoent guidelines provided. 



u4 otrrieulia d«v«lopii0nt. It is thtnforo proposed that the tvaluatloa team 
also play a stibstaatlal rola In aiding tha projoet In tha conpllation of the 
Infoxaation ntadad to docuaant tha program. Because this tasm will be Intinately 
£adliar vlth tha program as part o£ tha evaluation effort, they will be in a 
poaitloci to work vlth the staff in producing those doctaients most useful in 
dissemination efforts. 

Although this task might be reasooably classified as program development 
rather than evaluation, tha proposal to include such efforts und^ar the services 
provided by tha evaluation team is Justified on the following grounds. First, 
the evaluation team will be conducting a program analysis in order to determine 
an evaluation design and thxis will be in a position to describe wtiat has been 
done in the past, cxunrent activities and new developments. A particularly fine 
opportunity exists within the fine arts program tc ^c^cument these new activities 
such as the selection and appropriate criteria for selection of teachers/masters 
* from the arts coomiunity. Second, classroom teachers have little or no training 
and escperience in curriculum writing and documentat^ and community arts people 
can hardly be expected to be at all familiar «rlth such tasks. Thus, these 
individuals need training in the appropriate record .w iping and the synthesis of 
teachixig ideas into a curriculum. The «:va!ar. ^^ . .m on this project has had 
eaperience in these areas and will provide the necessary training, record keeping, 
instruBMntatlon and feedback in the davelopoent of the cvirriculum. Finally, even 
though teachers in a program may be effective In de]ii;onstrating their activities 
or in using them for instruction, they usually do uo£ have the skills and/or 
time to engage in the orgsnlsatlon and production of curricular materials while 
engaged in full-time positions. Thus, a package could b« produced which can be 
demonstrated by the teachers and circulated even more widely to those unable to 
visit the program. Because materials such as tiicse are rare for the middle school 
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aft Uv«l chil4 ^or both the uea o£ Intellectual gl£tedness end £lne erta, 
these aaterials should have widespread usefulness. It has been repeatedly noted 
that even we Unfunded gifted progresis are unlikely to undertake such tasks and 
produce suah decuMnts without considerable outside support and guidance. 

These points should not mask the usefulness of these activities to the 
Saginaw Township program Itself. It should not go unnoted that a docunent which describes 
the progrsA, its goels and objectives, the activities which might contribute to 
the achlevMent of the goals and objectives as ttqII as ways of evaluating 
achievement of those goals will be Invaluable to an ongoing program. Too often 
a good idea or activity disappears after its use because of lack of an 
organisational stru^txire for saving it and incorporating it into the curricultaa. 
k new teacher to a program is often faced with constructing an entirely new 

curriculum because the old currlculm left with the former teacher. Our goal 

will be to train teachers in: (1) developing such a structure; (2) recording 
their activities as part of the structure and (3) demonstrating this process to 
o^rs. 

Frankly^ 'in order for a successful program and curriculum to be in its most 
usabU form, thftxfd erast be a written record t/hich is organized and concise. A 
series o^tes »M rmxdm documents reqxiire much interpretation and can often 
prove toe c^bers^na f^c ready understanding. Our function will be not only to 
aid in the efforti^ the staff to provide a clear, useful doctaient but also to 
get external validation of the usefulness of the doctment. The steps in the 
process are given below. The process will be carried out with each component 
of the prograois. 

I. Review Eadsting Program Documents and Lesson Plans 
IZ. Developing and Organizing Structxire in Cooperation with the Staff 

m. Develop Format for Collecting Data for Curriculum Development and 
Train Staff in Its Use 
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•i^#pili|||i^^ tUt. of ^ critical ' 




iM^litiba aad-yailaata a aeasura of self* 

.... ^....^^....^.^^.Jwyf^^ 

^Spi^y^i^^^ will -wrlta' 'and' "produca • unit ■testa for tbm 

staff, will 

ThAj py taam %rill dayelop a foznat for organizino a 

curriculum. V/:, ...^ ■ 

The avaltaation taam will davelop a blueprint/outline for a 
flbdal Evaluation Manual. 



TlMi following ta^ka have bean determined as being those of 
Mjor iinpprtahce in meeting this object^ly^^ 

Evaluation of the Existing Procrram for the Intellectually Gifted . 

The general rationale for the activities in t^s component h^ 
been given in the original proposal. The specif ic activities to be 



carried put during the first year of 



the project are outlined below: 



Z. Program Analysis (to be coa^lete 1^ August, 1979) 

A. Analysis of Existing Documents 

B. Analysis of Data Collected 1977-1979 

C. Site Visits 

D. Product • Written Description of Current Program 
Including History 

II. Evaluation Design (to be cooqplete by August, 1979) 

A. Pre-post CQoqparison on instruments in III-l. 

B. Post test control group con^arison on instruments in 
III-l. 

C. Attitude surveys 

D. Product - Evaluation Plan for 1979-82 , 
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D«v«lopnMnt of Instrumentation (trial instruments 
b7 August, 1979) 



A* Instrument to measure Child Progress incCritical 
Thinking Skills 

B. Instrument to Measure Child Self -perceptions (e.g., 
independence, relationship to other gifted, awareness 
and acceptance of talents) 

C . Parent Perceptions 

D. Teacher Perceptions 

E. Administrator Perceptions 



Refinement and Validation of Selected Instruments from III-I 

A. Assessment of Critical Thinking Skills 

1. Pilot Test of Items (pre test) for Saginaw students 

a. Calculate item analysis data (difficulty, 
discrimination, ambiguity, etc.) 

b. Assess internal consistency 

c. Assess equivalent forms reliability 

d. Refine instrument and administer a post test 

e. Collect IQ (grades 5-8) and Ross Test (grades 
5-6) data for use .in construct validation 

2. Assess Content Validity of Instrument - Expert opinion 

3. Control Group Validation on* Refined Instrument 

a. Identify matching populations of intellectually 
gifted stxidents (oh« in a gifted program, one 
not in a gifted program) 

b. Adndnister refined instruments as a post test 

c. Administer Ross Test (grades 5-6) 

d. Gather data on IQ, achievement 

e. Assess equivalent forms reliability, internal 
consistency 

f . Assess convergent/discrifflinemt validity 

4. Draw up plan for the collection of norm group data in 
1980-^1 

5. Prepare a final "ready-to-go" instrument and 
administration manual « product 

B. Child self -perception instrument 

1. Same procedures as aibove (except substituting 
appropriate measures for construct validation 
and eliminating equivalent forms reliability) 

C. Attitude Survey Forms 

1. Assess internal consistency and content validity as 
appropriate 



50 



V. Bactaxaal Sxp^rt validation of id procedures, curriculum 
«ad program. 



VI. Collect evaluation data, analyze data 



vn. Prepare a fizial report 



Bvaluation of the Fine Art» Component 

Til* n^onale for thia aspect of : the evaluation is much the same 
one nptpd in. the earlier proposaJL with one significant additional 
consiMinitiQ&, i.e., tools for assessing ach^ in the fine arts 

are mn seaxper than those for measuring critical thinking skills 
and ifill require by^^^^ t^ nature the consideration of unique 

and anre ertetive assessiiieht* The plan for the iviltiatibn of this 
coMon^t plan for evaluating the 

«ei«tlr»g prognm for the^^ i^^ trith one 

notable 4K£arenoe - timing. That la, the existing ptogram has its 
goals and objectives identified and has a program in place. The 
new program is not clearly defined nor is the curriculum developed. 
Therefore, program analysis will be a major focus of the academic 
year and instalments will only be in tryout form by June, 1980. 

Z. Program Analysis (to be complete by June, 1980) 

• * 

A. Analysis of Developing Program (including an analysis 
of such factors as characteristics of successful 
instructors, ect.-) 

B. Site Visits 

Cv. Product ■ written Document Describing the Existing 
Program and Its Development 



II. Evaluation Design 

A. Post testing on Pilot Instrument (see III-A below) 

B. Post test Control Group Con^arison on Self -perception 
Instrument (see III-B under Bvaluation of Existing 
Instrument) ^ 

C. Attitude Swrreya // 

D. Product ■ Evaluation Plan/ for 1979-1982 



III. Development of Instrumentation 

A. Development of several alternative strategies for 
measuring achievement in the fine and performing arts 
(1^ January, 1980} 

B. Parent Perception Instrument 

C. Teacher Perception Instrument 



51 



D. Adi«iiilatrator P«reftption Znstrunaat 
B. Cennanlty Instructor Instrumttnt 

P. S«lf*P«rc«ptXon Instrument (as In III-B in Evaluation of 
Bxtsting Program) 



IV. Raf iQttaant and Validation of Instruments in III above 

A. Achievement in the Fine and Performing Arts 

1. Assessment of inter-rater reliability, internal ' 
consistency of proposed strategies (Because we 
are likely to rely on video tape, audio tape, 
product and performance assessment, as well as 
paper and pencil knowledge, this will bn crucial.) 

B. Same Procedures will be used for Ill:C-6 as in 
Bvaloation of Existing Program 



V. Collect Evaluative Data, Analyze and: 



VI. Prepare Final Report 



Preparation of Program Descriptions and Curriculum Guides for Both 
components o£ the Project ~ • 



. I. Review Existing Program Documents and Lesson Plans 



II. Developing and 0rg«uii2ing Structure in Cooperation with 
the Staff 



III. Develop Format for Collecting Data for Curricvilum 
Develo^aent and Train Staff in Its Use 



IV. Collect Missing Elements in Existing Data 



V. Prepare Curriculum Guide in Conjunction with Project Staff 



Draft of Evaluation Manual 

Many programs for the gifted find themselves unable to produce 
valid and credible evidence of their effectiveness to funding agencies. 
This shortconing seriously jeopardizes the existence of these programs. 
This project offers the ^portunity to provide guidelines to those 
se«hi.r<? to evaluate their programs in an efficient yet justifiable 
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fashion through an ongodLng example. The evaluation mamiial will docioment 
the evaluation process in a step*»by->step fashion giving rationale 
azid guidelines for its use plus the instrrjunentation described in the 
preceding pages. It will also provide the current Saginaw Township 
project with the means to carry on an inexpensive ^ continuous 
monitoring of its own program amd to demonstrate to others how 
evaluation can be carried on by local personnel with a minimiom of 
consultative time. During the first year an outline of the process 
of completing the first year's activities will be drawn up with 
sample work pages and instnoment development guidelines provided. 
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AFPEHDIX D; 



ACXiVrn (USD TORtttX 



t 

t ' • - . 




Date Used j 


Suit 






Focus: 




RMpurces 


Activity 




Mattrlala: 


Teacher: 




Persons: 


Students: 




Facilities: 




ggtriddim Activity; 




Eat:(Mted Tine 
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% 



"■':X 




ERIC 



mmn z: sjufle Acnvm cards for fine arts 



OSBit: 1— dtrU Thjafr md Voice 



fooui: Iiidlvldiial IntweptiitmtlOM 



L«v€l: All Datt: wk of 

JMXI. 21 



of Y«rtoii# tons o£ lltaratura 



Activity 

T— char; Providos collection 
of aiipro]prlata aaterlal. 
Provldis goldnice in selection 
of ifttterijCL 
lat^c|rre^ 

Studeitt: Selects aeterlal. 
Pr^^ttes end p oral 
Interpretatlm. 



Reeourcee 
Flouted aateriala 
R/^rodiictioa 



Precedlag activitiea: Vocal exerciaes 
FcAloiilot activitieai Reader's theater 



Tlae: 15 sin each day 
for 4 days, 1 hr« flftH 
day.' 



thiit; Fhotoarapfa^ 


Level: 7,8 


DateCs): 


Foenas Visual Contrast 






Objectives 


Activities 


Resources 


1* Beeognltlon of contrast 


Teacher: Introduces coneots 


Csaeras, film 


as a design elenent 


of visual contrast & provides 


Darkroom 


2. Skill In recognising & 


exsnples 


Examples of 




Student: Takes and processes 


visual contrast 


contrast 


photographs illustrating 






visual contrast 





Preceding Activities: Darkroom techniques, camera techniques Time: 1 hour 

Following Activities: Subject met ter contrast (emphasized by each of 2 days 

visual contrast) 



1i9tm TlM AUot«d Grad« 



GoaX: 

(iMtrqaitntal ObjMtlvw) 



Specific Goal: 
(Bahcvloral ObjwtlvM) 



Procadura: 

B« TiMding QaMtlons 



TMchar Pr«p«ratlo&: 



Hatariala: 



Ivaluatloa: 
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Art Student Evalmtlon 



Oat* 



X. SkilU/AbllitiM 

fimlepowat o£ drswlttg abllltle* 

B«v«lopnttt of exaftraaaahlp 

DvvtlopMnt of dstlgn conetpts 

Devolopm«&t of ability to tuke 
Idiotic JudgBMAtS 



School 
Grade 



littl* or 
no progreaa 

12 3 

1 2 3 

'l 2 3 



a groat doal 
of preareaa 

4 .5 



4 
4 



S 
5 



Dt7*lo(MM9t of ability to create 
*^ respond to nedla 

bevelopneot of techxdLeel skills 

. ' . ■ 

IX. Effort/Attitude . ^ 

Vo^ op to potential 

Oenmatrataa (ability to concentrate) 
(taafc eonBdtae&t) ;^ 

Shoei pride in own work 

tsodneea vork oataide of claaa 

' / Zft eager to psrtieipata in sctivitles 



1 
1 

• never 

. 1 

I 

' 1 

\ I 

■ .* .'J 
••I-'-.- 



2 
2 



3 
3 



2 3 

■ • ■ ' 

2 ■ • 3- 
2 . 3 
2 3 



4 
4 



4 
4 
4 



:■ . 5 

alvava 

■■•■5 A- 

/ 5 . 



'm aifDatBT* 



Student 'a algnatvre" 



eo 



Date 



I. Davtlopome of Sklllt: 
Zttvmtivmtsi - Creativity 
laaglnatloa 
Gonamleatlon 
Caneaatratlott 
Craftraaathlp 

Groap Ralatiottfl - Cooperation 

Body Avareneea ^ Coordination 

MoBory 

Obaervation 

Self Aaaorance 

HlM Aetlvitied 

ZI» Effort ond AttitttJe: 

Extent to vhieh he applied him/her- 
aelf in creative activities 

Sagemeaa to take part 

Ezpreaelon in creative aetivltiea 

Ability and «rilllngnesa to contribute 
to groop actlvitiee 

florklng up to potential 

Bnthcialasia for dramatic activity 

Senaltlvlty to creative atiinulation 
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AFPENDIZ 6 

PROGRAM PLANNING SURVEY 
Prepared by 
Carolyn M. Callahan, University of Virginia 
Michael S. Caldwell, University of Virginia 
INTRODUCTION 



As part of an effort to evaluate the Saginaw Enrichment Center program 
for gifted and talented students, ve are Interested in ascertaining the 
degree to which various groups of individuals have been informed about 
the goals and implementation of the program. Furthermore, we are trying 
to aasess the degree to which there is general agreement among these groups 
as to what the program should be. Your cooperation in this effort will be 
greatly appreciated. 

This instrument actually has two parts. In Fart I you will be asked 
to respond to a series of statements according to your own personal know-* 
ledge of various aspects of the program. This is not a test of your compe- 
tence in any way, but rather a means of assessing communication between the 
program and you. Part II will require you to state your opinion about what 
should be or what you would like to include as part of the program for gif t^.d 
students. Your opinion need not agree witly stated goals and objectives of 
the program. 

Please complete the Instrument in the following manner; 

I. Read the instructions for Fart I found on page 2 very 
carefully and complete all items relating to your know- 
ledge of the program. It might be helpful to tear page 
2 from this booklet to keep beside the answer sheet as 
you complete Part I. 

II. Now read the directions for Part II found on page 3 and com-- 
plete this section relating to your opinion. Again, it may 
be helpful to tear out page 3 and keep it beside the answer 
sheet while you complete this section. 

All items should be answered on the enclosed answer sheet. 
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DIRECTIOMS: On psges 4 - 6 of this booklet you will find statements which 
represent Ideas about or descriptions of definitions, goals, and objectives 
for programs for gifted and talented students, proccdurec for Identifying 
these students, or teaching strategies and evaluation procedures. In this 
section of the questionnaire we wish for you to indicate to the beat of your 
knowledge Aether or not the statement reflects an idea which is consistent 
with the program for gifted and talented students in Saginaw. 

Each statement is preceded by two numbers, one of which is In paren- 
theaes. For Part I, disregard the number in parentheses and mark the num- 
her of your answer sheet which corresponds to the first number. After you 
have read each statement blacken the space on the answer sheet according to 
the directions. 

Mark A if to the best of your knowledge this statement is 
Inconsistent with the policy of the program for 
gifted and talented students in Saginaw. < 

Mark ^ if to the best of your knowledge the program in 

Saginaw has no position relative to this statement. 

Mark C if to the best of your knowledge this statement is 
consistent with but not emphasized in the Saginaw 
program for gifted and talented students. 

Mark D if to the best of your knowledge this statement 

represents an integral part of the Saginaw program 
for gifted and talented students. 

Mark E if you do not know the position of the Saginaw program 

for gifted and talented students relative to this state- 
ment. 

Please read each statement carefully. It may be helpful for you to 
tear this page from the booklet and place it beside the answer sheet as you 
respond to items 1 55. 

After you finish Items 1 - 55, please go to the directions for Part 11 
found on the next page* 
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PROGRAM PLASHIHG SURVEY STATEMENTS 

1 (56) Onti of th« aajor goals o£ the Saginaw Enrichment Center for Gifted and fal- 

OBted Stodenta la the development of skills in self-evaluation. 

2 (57) Gifted students can be taught nore effectively when grouped with other 

gifted children than when heterogeneously grouped. 

3 (58) Gifted children make. greater progress when placed la special gifted elass^a 

than when they renaln in their regular classes for special instruction. 

* (59) Providing for gifted children within the regular classroom takes up too much 
of the regular classroom teacher's tine. 

5 (60) Analytical thinking and problem solving skills constitute the central focus 

of the gifted program. 

6 (61) The adbool has to be concerned with the fundamental learnings and skills for 

all children and not with special programs for students with outstanding 
abilities and needs. 

7 (62) Children %rtio have not mastered basic skills should be excluded from the 

Saglnmr Enrichment Center for Academically Gifted Students. 

8 (63) The Saginaw definition of gif tedness relies on demonstrated achievement 

rather than potential. 

9 (64) Gifted students require programs beyond those normally provided by the reg- 

• ular school program of Saginaw Gounty. ■ 

10 (65). It is more important that gifted students master basic skills than it is 

that ''normal*' students master basic skills. 

11 (66) Gifted stixdents are high achievers. 

12 (67) The quantity of work which gifted students are expected to produce is typ- 

ically greater than for the "normal" population of students. 

13 (68) Gifted students teed to be more socially responsible in terms of being able 

to work independently. 

14 (69) Academically gifted students are above average in all areas of academics. 

15 (70) Gifted students require more rather than less individual attention from 

teachers. 

16 (71) Any student with an IQ of at least 130 on a group IQ test will be auto- 

matically selected for the academic program for gifted sttxdents. 

17 (72) Factors of independence, maturity, motivation, and self-discipline are con- 

sidered before students are allowed to participate in the Enrichment Center. 

18 (73) The most Important kind of ability to consider in a gifted program is in- 

tellectual or mental ability. 

19 (74) Special modifications have been made in the identification procedures to 

accoomiodate culturally different groups of children. 



20 (75) A strong taough tMchar recoonendatlon can qualify a student for placeffl«tft 
- la elM Saginaw Enriehneat Canter. 

»/'2I (76) SCttdants who miss regular classroom work are required to make up that 
work. 

22 (7"») On* of tha prlaairy thinking processes used by students in the Saginaw En- 

rlehMne Cantar is generalization. 

23 (78) On* of the priaary thinking processes used by students in the Saginaw En- 

rieteant Center is interpretation. 

24 (79) The application level of Bloom's Taxonomy is emphasized by the Saginaw 

Knricfaoiant Center. 

.'25 (80) Thla obj active is appropriate for academically gifted students: The stu- 
dent will be able to predict; consequences of certain changes in the en- 
viromcnt. 

26 (81) . Thla objective is appropriate for acadeaically gifted studetns: The stu- 
dent will be able to develop category systems for a given aet of objects. 

y 27 (82) This objective is appropriate for academically gifted students: The stu- 
dent will be able to translate information from cartoon form to written 
form. 

28 (83) Classroom objectives for gifted students should be the same as for "nonaal 

students except that gifted students will be expected to achieve more of 
those objectives and at a faster pace. 

29 (84) The accomplishment of higher level thinking objectives in a given content 

area is dependant upon mastery of the lower level thinking processes. 

30 (85) Tha negative effects of pulling gifted students out of the regular class- 

room and grouping them in special sections and/or classrooms are greater 
than' any positive benefits which might be realized from this practice. 

31 (86) Grouping for specific subject matter atudy is the most appropriate alter- 

native for students with specific aptitudes. 

^32 (87) Critical thinking is a major objective of the Saginaw Enrichment Center. 

33 (88) Tha major goal of the Enrichment Center is to extend activities of the 
regular classroom. 

j/34 (89) Opportunity for Independent study is an integral part of the Saginaw En- 
ridnant Center. 

V 35 (90) Tha development of creativity is an objective of the Saginaw Enrichment 
Canter. 

/is (91) Values clarification activities are appropriate activities for the En- 
ricfaawnt Center. 

37 (92) The '*Graat Books Program" is an important part of Enrichment Center Ac- 
tivity. 
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38 (93) Tueher8 of the gifted should be required to attend In-^servlce training 

foeuelAg on the eduatlon of the gifted on a regular basis. 

39 (94) Inttructlonal materials for gifted students need not be different from 

those used by other students, but gifted students can be expected to 
^ Interact with the materials at higher levels of intellectual functioning. 

AO (95) Too many supplies are used in a gifted program and denied to the other 
children. 

Al (96) Instructional materials for gifted students should focus upon the devel- 
opment of higher order cognitive skills. 

42 (97) Units for the Enrichment Center are interdlsclplina^7 in scope. 

A3 (98) Students in the Enrichment Center learn research skills. 

44 (99) Students \rtio qualify for both the academic and fine arts program may at- 

tend both programs. 

45 (100) The task outlined below is appropriate for use with gifted and talented 

students: Design an animal for a pet from parts of extinct animals. 

46 (101) The task outlined below is appropriate for use with gifted and talented 

students: Modify a recipe for use by a diabetic. 

47 (102) The task outlined below is appropriate for use with older gifted and tal-- 

anted students: Validate the need for a winter vacation. 

48 (103) The task outlined below is appropriate for use with gifted and talented 

students: Classify foods by basic food groups. 

49 (104) The provisions made within the Enrichment Center are sufficient to meet 

the needs of gifted children* 

50 (105) The curriculum for gifted and talented students should focus on process 

rather than product. 

51 (106) The program for academically gifted students in Saginaw includes teaching 

stiidents about Bloom's Taxonomy and the thinking processes of analysis, 
, synthesis and evaluation. 

52 (107) The role of the teacher in working with gifted students changes focus - 

from a provider of information and superlvsor of activities to that of a 
counselor and facilitator. 

53 (108) Within the context of a TAG program the focus of student evaluation is on 

the process rather than the product. 

54 (109) Standards (both in terms of quality and quantity) should be set higher 

for gifted students than for ''normal'' students. 

55 (110) Reporting atudent progress (I.e., grades and report cards) for gifted 

^ students should be^dlfferent from the student progress reports for 
"normel" students. 
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PART II 



DIRECTIOMS : For items 56 - 110 you will be asked to reread the same stac:- 
■•ats that you responded to in Part I except that this time you will be 
askttd to state your feelings about the appropriateness pf the ideas pre- 
santed for a program for gifted and talented students in Saginaw. Please 
respond openly with your opinions. . | 

In this seetloiiy please go back to the first statement on page 4. Yu«: 
vili begin marking your answer sheet at number 56 whic^ corresponds to the 
number in parentheses preceeding that item. For each sjtatement blacken in t-.*: 
space on the answer sheet which corresponds to the number in parentheses pro- 
ceeding the statanent. Respond according to the description given below 
which best represents your feelings. 

Mark A if it is your opinion that the ideas implied by this 
statement should not be incorporated into the Saginaw 
program for gifted and talented students. 

Mark. B if it is your opinion that the ideas Implied by this 
statement are appropriate for the Saginaw program for 
gifted and talented students but should receive only 
minor emphasis . 

Mark C if in your opinion the ideas Implied by this statement 
should be stressed in the Saginaw program for gifted 
and talented Students. 

Tou may find it helpful to tear out this page to keep beside the 
answer sheet as you complete items 56 - 110. 



68 



